Information displaying system and information providing terminal

ABSTRACT

In an information providing terminal, a display switching controller instructs to switch between pieces of display content of a third display panel from an image of a face of a user captured by a first camera to an image captured by any one of a second camera, a third camera, and a fourth camera. The display switching controller instructs to switch between pieces of display content of a fourth display panel from an image of hands of the user captured by the second camera to an image which is captured by any one of the first camera, the third camera, and the fourth camera.

TECHNICAL FIELD

The present disclosure relates to an information displaying system andan information providing terminal which display information.

BACKGROUND ART

A multimedia terminal (for example, refer to PTL 1) has been known whichperforms communication with a terminal used by an operator who is acommunication partner existing in a separated location, and enables auser to exchange various pieces of information with a feeling of facingthe operator.

The multimedia terminal disclosed in PTL 1 includes cameras and threedisplays, images a face and hands of the user using the cameras, andtransmits imaged pictures to the terminal used by the operator. Inaddition, among the three displays, the multimedia terminal causes afirst display to display the face of the user, causes a second displayto display multimedia information, such as text, still images, andmoving images, and causes a third display to display a touch panel andan input panel on which it is possible to input characters, symbols, andthe like. Furthermore, the multimedia terminal includes a microphone anda speaker in order to make a call with the terminal used by theoperator.

However, in a case where only a facial picture of the operator isdisplayed on a display of a multimedia terminal used by the user incommunication between the multimedia terminal used by the user and theterminal used by the operator, it is not sufficient to supply the senseof realism in which the user actually performs exchange with theoperator.

Furthermore, in order to make the user to brim with the sense ofrealism, it is necessary to accurately and rapidly send information tothe user, and it is desired to improve usability for the operator byinstalling a camera which images a face and hands of the operator and anoperator-side monitor on which the face and the hands of the user aredisplayed.

An object of the present disclosure is to provide the sense of realismthat the user actually faces a communication partner, and to improve theusability for the operator in a case of using the camera which imagesthe face and the hands of the operator and the operator-side monitor onwhich the face and the hands of the user are displayed.

CITATION LIST Patent Literature

PTL 1: Japanese Patent Unexamined Publication No. 2004-147105

SUMMARY OF THE INVENTION

According to the present disclosure, there is provided an informationdisplaying system, in which an information displaying terminal that canbe operated by a user is connected to an information providing terminalthat can be operated by an operator such that communication is possible,in which the information displaying terminal includes a first camerathat captures an image of a face of the user; a second camera thatcaptures an image of hands of the user; a first communicator thattransmits the image of the face of the user and the image of the handsof the user to the information providing terminal, and that receives animage of a face and at least a part of an upper body of the operator andan image of hands of the operator which are transmitted from theinformation providing terminal; a first display panel that displays theimage of the face and at least the part of the upper body of theoperator; and a second display panel that displays the image of thehands of the operator, and in which the information providing terminalincludes a third camera that images the face and at least the part ofthe upper body of the operator; a fourth camera that images the hands ofthe operator; a second communicator that transmits the image of the faceand at least the part of the upper body of the operator and the image ofthe hands of the operator to the information displaying terminal, andreceives the image of the face of the user and the image of the hands ofthe user which are transmitted from the information displaying terminal;a third display panel that displays the image of the face of the user; afourth display panel that displays the image of the hands of the user;and a switching processor that instructs to switch between pieces ofdisplay content of the third display panel from the image of the face ofthe user captured by the first camera to the image captured by any oneof the second camera, the third camera, and the fourth camera.

In addition, according to the present disclosure, there is provided aninformation providing terminal, which is connected to informationdisplaying terminal that can be operated by a user such thatcommunication is possible and which can be operated by an operator, theinformation providing terminal including: a first camera that images aface and at least a part of an upper body of the operator; a secondcamera that images hands of the operator; a communicator that transmitsan image of the face and at least the part of the upper body of theoperator and an image of the hands of the operator to the informationdisplaying terminal, and receives an image of a face of the user and animage of hands of the user which are transmitted from the informationdisplaying terminal; a first display panel that displays the image ofthe face of the user; a second display panel that displays the image ofthe hands of the user; and a switching processor that instructs toswitch between pieces of display content of the first display panel fromthe image of the face of the user captured by the first camera to anyone of the image of the hands of the user, the image captured by thefirst camera, and the image captured by the second camera.

According to the present disclosure, it is possible to provide the senseof realism that the user actually faces a communication partner and toimprove usability for the operator in a case of using the camera whichimages the face and the hands of the operator and an operator-sidemonitor on which the face and the hands of the user are displayed.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an example of a schematic configurationof an information displaying system according to a first exemplaryembodiment.

FIG. 2 is a block diagram illustrating an example of insideconfigurations of an information displaying terminal and an informationproviding terminal according to the first exemplary embodiment indetail.

FIG. 3 is a perspective diagram illustrating an example of appearance ofthe information providing terminal.

FIG. 4 is a perspective diagram illustrating an example of an insidedisposition of the information providing terminal in a state in which atop plate and a side plate on one side are detached.

FIG. 5 is a diagram illustrating an inside of the information providingterminal in the state, in which the top plate and the side plate on oneside are detached, viewed from a lateral side.

FIG. 6A is a diagram illustrating a positional relation between a halfmirror and a third camera.

FIG. 6B is a diagram illustrating the positional relation between thehalf mirror and the third camera.

FIG. 6C is a diagram illustrating the positional relation between thehalf mirror and the third camera.

FIG. 7A is an appearance diagram illustrating an information displayingterminal, which is viewed from a front direction, according to a firstmodification example.

FIG. 7B is an appearance diagram illustrating the information displayingterminal, which is viewed from a lateral direction, according to thefirst modification example.

FIG. 8A is a perspective diagram illustrating an appearance of aninformation displaying terminal according to a second modificationexample.

FIG. 8B is a diagram illustrating the information displaying terminal,which is viewed from the lateral side, according to the secondmodification example.

FIG. 9A is a perspective diagram illustrating an appearance of aninformation displaying terminal having a normal size according to athird modification example.

FIG. 9B is an appearance diagram illustrating an information displayingterminal having a small size according to the third modification examplein the front direction.

FIG. 10 is a block diagram illustrating an example of insideconfigurations of an information displaying terminal and an informationproviding terminal according to a second exemplary embodiment.

FIG. 11 is a diagram illustrating an example of a switching menu whichis displayed on a fourth display panel.

FIG. 12A is a diagram illustrating an example of a display screen of athird display panel in each use case.

FIG. 12B is a diagram illustrating an example of the display screen ofthe third display panel in each use case.

FIG. 12C is a diagram illustrating an example of the display screen ofthe third display panel in each use case.

FIG. 13A is a diagram illustrating an example of a display screen of afourth display panel in each use case.

FIG. 13B is a diagram illustrating an example of the display screen ofthe fourth display panel in each use case.

FIG. 13C is a diagram illustrating an example of the display screen ofthe fourth display panel in each use case.

DESCRIPTION OF EMBODIMENTS Details of First Exemplary Embodiment

In a case where a configuration of a system, in which a user and anoperator who are in separated locations make a call (conversation), isreviewed, the following defects exist if a camera which images a face ofthe operator and an operator-side monitor, on which a picture of a faceof the user is displayed, are separated and disposed on a side of theoperator. That is, in a case where the operator talks with the userwhile viewing the monitor, the camera images the face of the operatorfrom an angle which is different from an angle at which the operatorviews the monitor. In this case, the face of the operator is projectedonto a monitor, which is provided on a side of the user (that is, amonitor on which a picture of the face of the operator is displayed),such that the operator views a separate direction from a direction inwhich the operator views the user. Accordingly, it is not possible forthe user to perform natural communication, in which the user talks withthe operator with a gaze that faces the same direction, and thusunnatural talk is made.

In contrast, in a case where an operator-side terminal is disposed inorder to enable the natural communication between the user and theoperator, it is not simple to dispose the camera to be close to a placewhere the monitor is installed rather than expected. Therefore,according to the disposition of the camera, useless empty space isgenerated due to a relation with a location where the monitor isinstalled, and thus it is difficult to save space.

Here, in a first exemplary embodiment, an information displaying systemand an information providing terminal which save a space of aninstallment device in disposition of the operator-side terminal andwhich are capable of performing communication with the user with naturalgaze will be described.

Hereinafter, exemplary embodiments of the information displaying systemand the information providing terminal according to the presentdisclosure will be described with reference to the accompanyingdrawings. However, there is a case where unnecessarily detaileddescription is omitted. For example, there is a case where detaileddescription of already well-known matters or repeated description ofsubstantially the same configuration is omitted. The reason for this isto avoid description below being unnecessarily redundant for easyunderstanding of those skilled in the art. Meanwhile, the accompanyingdrawings and the description below are provided such that those skilledin the art sufficiently understand the present disclosure, and it is notintended to limit subjects disclosed in claims.

Information displaying systems according to the respective exemplaryembodiments below are applied to systems in which a user who is, forexample, a customer entered in a facility communicates with an operatorwho is waiting at an operation center at a distance and it is possibleto receive various pieces of guidance from the operator.

First Exemplary Embodiment

FIG. 1 is a diagram illustrating an example of a schematic configurationof information displaying system 5 according to a first exemplaryembodiment. Information displaying system 5 includes user-sideinformation displaying terminal 10 and operator-side informationproviding terminal 50, which are connected to each other through network90. Information displaying terminal 10 and information providingterminal 50 are capable of communicating various data (text data,picture data, sound data, and the like) with each other through network90.

A wired Local Area Network (LAN), which is connected to a wide areacommunication network, such as the Internet, a wireless LAN, a dedicatedline, or the like is used for network 90. In addition, both informationdisplaying terminal 10 and information providing terminal 50 are capableof accessing various server devices (not illustrated in the drawing)which are connected to network 90.

Information displaying terminal 10 is loaded on box-shaped stand 12having a certain height to be adjusted to a height of a person. Stand 12is integrated with information displaying terminal 10 by, for example,being coated with the same color as a housing of information displayingterminal 10 or being covered by a cover which is common to informationdisplaying terminal 10. Information displaying terminal 10 includesfirst housing 15 that is provided to protrude upwards so as to face aface of the user, and a second housing 18 that is extended to a frontside such that hands of the user (that is, the span of the hands, whichincludes some parts of hands, arms, palms, nails, and the like. The sameas above) can be in contact with.

On a front surface of first housing 15, first display panel 21 isprovided onto which an image of a face and at least a part of an upperbody of an operator captured by third camera 63, which will be describedlater, is projected. On first display panel 21, the image of the faceand at least the part of the upper body of the operator is displayed ina size which is approximately the same as an actual size. Therefore, itis possible for the user to acquire a sense of realism that the useractually faces the operator. In addition, an upper front surface offirst housing 15 is provided with second camera 32 that images vicinityof the hands of the user. A lower front surface of first housing 15,that is, middle part 15 z of the housing, in which first display panel21 and second display panel 22 are disposed, becomes an area in whichthe display panel is not disposed. Middle part 15 z is provided withfirst camera 31 that captures the image of the face and at least thepart of the upper body of the user. In addition, in the vicinity of theboth ends of middle part 15 z, a left-and-right pair of speakers 25L and25R (an example of an output device) that output sound data emitted bythe operator are provided. In the vicinity of a center of middle part 15z, microphone 27 (an example of an input device) that absorbs soundemitted by the user is provided. In a case where the output device andthe input device are disposed in middle part 15 z of the housing, inwhich first display panel 21 and second display panel 22 are disposed,the operator is naturally projected onto first display panel 21, andthus increase in the sense of realism is further expected.

In contrast, an upper surface of second housing 18 is provided withsecond display panel 22 onto which an image of the vicinity of hands ofthe operator captured by fourth camera 64, which will be describedlater, and a User Interface (UI) screen, and the like are projected.Second display panel 22 may include a display device that only displaysa picture, or may include a touch panel on which a touch input operationis possible. In a case where second display panel 22 includes the touchpanel, information acquired through touch input is transmitted, frominformation displaying terminal 10 to information providing terminal 50or various server devices which are connected to network 90. Here, thecase where second display panel 22 includes the touch panel will beillustrated.

In addition, front end surface 18 z of second housing 18 is disposedwith an exhaust slot of printer 40 that is capable of performing hardcopy of the screen which is displayed on second display panel 22. A mainbody of printer 40 is embedded in stand 12. In addition, front endsurface 18 z of second housing 18 is installed with reading device 42that reads authentication information (for example, various pieces ofinformation relevant to a card, which are requested in a case where acard settlement process is performed, and a password number such asPersonal Identification Number (PIN)) used to perform personalauthentication of the user.

In contrast, information providing terminal 50 includes operational desk110. A structure of information providing terminal 50, which includesoperational desk 110, will be described in detail later with referenceto FIG. 3 to FIG. 5. Therefore, the structure will be simply describedhere. Meanwhile, FIG. 1 illustrates a state in which side plate 112 x(refer to FIG. 3) is detached and an inside is viewed in explanation.

In front of operational desk 110, operator op with headset 73 is sittingon chair 71 in a posture that is easy to perform guidance. Headset 73 isconnected to information providing terminal 50, outputs sound emitted bythe user, and absorbs sound emitted by the operator.

U-shaped or portal support stand 112 is fixed to an operational surfaceof operational desk 110. Support stand 112 supports electroniccomponents which will be described later. Third display panel 53, ontowhich the image of the face and at least a part of the upper body of theuser captured by first camera 31 is projected, and third camera 63,which captures the image of a face and at least the part of the upperbody of operator op, are supported by support stand 112.

In addition, fourth display panel 54 that displays the image of thehands of the user captured by second camera 32 is disposed to beinclined on the operational surface of operational desk 110 such that itbecomes easy for the operator to visually recognize fourth display panel54. A screen size of fourth display panel 54 is larger than that ofthird display panel 53, and is configured such that it becomes easy foroperator op to visually recognize the hands of the user. Fourth displaypanel 54 may include a display device that only displays a picture, andmay include the touch panel on which the touch input operation ispossible. In a case where fourth display panel 54 includes the touchpanel, information acquired through the touch input is transmitted frominformation providing terminal 50 to information displaying terminal 10and various server devices which are connected to network 90. Here, thecase where fourth display panel 54 includes the touch panel will beillustrated.

In addition, in a middle of bar 57 which extends on a side of theoperator from support stand 112, fourth camera 64 is provided whichimages the operational surface of operational desk 110 including thehands of operator op. Fourth camera 64 is capable of imaging the handsof operator op and is capable of imaging a resource, such as a guidepamphlet, which is loaded on operational desk 110. In addition,information providing terminal 50 is capable of capturing a Web site, aUI screen, and the like, which are displayed on fourth display panel 54,as the picture imaged by fourth camera 64. In addition, console 68, suchas a keyboard or a mouse, and scanner 69 can be loaded on desk 55.

As described above, user-side information displaying terminal 10displays the image of the face and at least the part of the upper bodyof operator op on first display panel 21 based on the picture datareceived from information providing terminal 50, and displays the imageof the hands of operator op, the UI screen, and the like on seconddisplay panel 22. Meanwhile, in a case where operator op loads theresource, such as the pamphlet, on the surface of desk 55, seconddisplay panel 22 displays the resource as well. In addition, informationdisplaying terminal 10 outputs the sound data, which is received frominformation providing terminal 50, from speakers 25L and 25R, andtransmits the sound data, which is absorbed by microphone 27, toinformation providing terminal 50.

In contrast, operator-side information providing terminal 50 displaysthe image of the face and at least the part of the upper body of theuser on third display panel 53 based on the picture data, which isreceived from information displaying terminal 10, and displays the imageof the hands of the user or the like on fourth display panel 54. Inaddition, information providing terminal 50 outputs the sound data,which is received from information displaying terminal 10, from speaker73 z of headset 73, and transmits the sound data, which is absorbed bymicrophone 73 y of headset 73, to information displaying terminal 10.

Here, a displayable area of third display panel 53 according to thefirst exemplary embodiment may be smaller than a displayable area offourth display panel 54 which displays the image of the hands of theuser or the like. The reason for this is as follows. An important thingfor the operator is that operator op shares a spot, which is directed bythe user, in a size similar to the user with respect to second displaypanel 22 which displays information (for example, the pamphlet, a map,or the like) around the hands of operator op imaged by fourth camera 64for the user. A certain size is necessary for the displayable area offourth display panel 54 which displays the image of the hands of theuser or the like. Furthermore, it is desired that a resolution and thenumber of pixels of fourth display panel 54 are similar to those ofuser-side second display panel 22. However, fourth display panel 54 maybe a general-purpose monitor. In contrast, third display panel 53, whichdisplays the face of the user (or the face and at least the part of theupper body), may be provided to the extent that operator op understandsan expression of the user and a situation of background, and thus thedisplayable area may not be large, and a high resolution and a largenumber of pixels are not necessary.

Therefore, the displayable area of third display panel 53 may be smallerthan the displayable area of fourth display panel 54 which displays theimage of the hands of the user or the like, and the resolution and thenumber of pixels of third display panel 53 may be smaller than theresolution and the number of pixels of fourth display panel 54. Thirddisplay panel 53 may be a general-purpose monitor. By this, it ispossible to form a system of operator op-side information providingterminal 50 using a general-purpose monitor, an information processingdevice (a Personal Computer (PC), a tablet terminal, or the like), or atelevision receiver. That is, it is possible to form operator op-sideinformation providing terminal 50 with a simple configuration ratherthan user-side information displaying terminal 10, and to realizenatural and smooth communication between the user and operator op.Furthermore, in a case where the system of operator op-side informationproviding terminal 50 is formed using the general-purpose monitor andthe device, degrees of freedom are provided to layouts of the respectivemonitor and device, and thus it is possible to normally dispose therespective monitor and device in optimal positions with respect todifferent operators.

FIG. 2 is a block diagram illustrating an example of insideconfigurations of information displaying terminal 10 and informationproviding terminal 50 according to the first exemplary embodiment indetail. Information displaying terminal 10 includes controller 11 thatintegrally controls respective units. In addition to the above-describedfirst display panel 21, first camera 31, second display panel 22, secondcamera 32, reading device 42, right and left speakers 25L and 25R,microphone 27, and printer 40, communication controller 20 is connectedto controller 11.

First display panel 21 includes an ultrahigh-resolution 4K (that is,3840 pixels×2160 pixels) display that displays a part of the face andthe upper body of the operator op. Meanwhile, first display panel 21 mayinclude a touch panel on which the touch input of the user is possible.

First camera 31 is an embedded camera disposed at a bottom of firsthousing 15, and captures the image of the face and at least the part ofthe upper body of the user who stands in front of information displayingterminal 10. Meanwhile, an angle of view of first camera 31 may beoperated by remote control from operator-side information providingterminal 50. A high-resolution full high vision camera, a high visioncamera, or a normal camera is used as first camera 31.

Second display panel 22 includes a touch panel which has the 4K displayas an interactive display panel, displays the image of the hands ofoperator op, an operation menu screen, an application screen, a website, various documents, or the like, and receives button pressingthrough a touch operation, write input, and the like. In addition,second display panel 22 receives an instruction to enlarge or reducescreen display through an input operation using fingers of the user or astylus pen.

Second camera 32 is an embedded camera which is disposed at an upperpart of first housing 15. The angle of view is fixed around seconddisplay panel 22, and second camera 32 captures an image of the hands ofthe user or the like who operates second display panel 22. It is desiredthat second camera 32 is a high-resolution camera of 4K or full-highvision. Furthermore, in a case where second camera 32 is a PTZ cameraand a desired location is zoomed in, it is possible to perform imagingsuch that details are visually recognized.

Speakers 25L and 25R are directional stereo speakers in which the userwho is in front of information displaying terminal 10 easily hears, andoutput sound or the like emitted by operator op. Microphone 27 is adirectional microphone which has an orientation direction with respectto the user, and absorbs sound emitted by the user. Meanwhile,microphone 27 and speakers 25L and 25R may be formed as a headset. In acase where the user operates information displaying terminal 10, theuser wears the headset on the head.

Printer 40 is capable of printing a screen of second display panel 22 ashard copy, and performing any one of monochrome printing and colorprinting. In addition, as a printing method, an inkjet method, a laserprinting method, an electrostatic recording method, or the like is used.

Communication controller 20 as an example of a first communicator is anetwork I/F that performs secure communication through communicationcontroller 60 of information providing terminal 50 and network 90.Specifically, communication controller 20 transmits data which includesthe image of the face of the user captured by first camera 31 and theimage of the hands of the user captured by second camera 32, toinformation providing terminal 50. In addition, communication controller20 receives an image of a face and at least a part of an upper body ofthe operator and an image of hands of the operator which are transmittedfrom information providing terminal 50.

Reading device 42 reads personal information of the user. For example, acontactless reading and writing device, which reads information of an ICtag through a contactless short distance communication, such as NearField Communication (NFC), or an IC card reading and writing device,which reads information of an IC card that is inserted into a slot, isprovided as reading device 42. Meanwhile, a biometric authenticationdevice, which performs personal authentication using a pattern such as afingerprint or a vein, may be used. In addition, the personalinformation of the user, which is read by reading device 42, may be usedas the authentication information for a settlement process or electronicmoney. In a case where the personal authentication is performed, it ispossible to enhance convenience and to exclude a forgery or the like.

Meanwhile, information displaying terminal 10 is a multilingualterminal. In a case where the user selects a language which ispreviously displayed on second display panel 22, information displayingterminal 10 automatically translates sound emitted by operator op into aselected language and outputs the translated sound through speakers 25Land 25R. In addition, information displaying terminal 10 has a functionof displaying the sound emitted by the operator using text, an OCRfunction of recognizing handwritten input characters, and the like.

In contrast, information providing terminal 50 includes controller 51that integrally controls respective units. In addition to theabove-described third display panel 53, third camera 63, fourth displaypanel 54, fourth camera 64, console 68, speaker 73 z of headset 73,microphone 73 y, and scanner 69, communication controller 60 isconnected to controller 51.

Third display panel 53 has a display which displays the image of theface and at least the part of the upper body of the user. Third displaypanel 53 is not limited to 4K, and may be a normal display, a highvision display, or a full-high vision display. Meanwhile, third displaypanel 53 may include a touch panel on which the touch input of operatorop is possible.

Third camera 63 is a camera that is attached to frame 112Z. Third camera63 captures the image of the face and at least the part of the upperbody of operator op which is displayed on first display panel 21 ofinformation displaying terminal 10, and thus it is desired that thirdcamera 63 is an ultrahigh-resolution 4K camera.

Fourth display panel 54 includes a touch panel which has a 4K display asan interactive display panel, displays the image of the hands of theuser, an operation menu screen, an application screen, a web site,various documents, or the like, and receives button pressing through thetouch operation, and the like. In addition, fourth display panel 54receives an instruction to enlarge or reduce screen display through aninput operation using fingers of operator op or a stylus pen.

Fourth camera 64 is a camera which is attached to bar 57, and capturesthe image of the hands of operator op, the pamphlet, and the like whichare placed on a surface of desk 55. Fourth camera 64 images the pictureof the hands displayed on second display panel 22, and thus it isdesired that fourth camera 64 is an ultrahigh-resolution 4K camera.Furthermore, in a case of the PTZ camera, it is possible to performimaging such that details are visually recognized.

Console 68 is an input device, such as a mouse or a keyboard, which canbe operated by operator op. Scanner 69 reads and scans the pamphlet orthe like.

Headset 73 is mounted on the head of operator op, and includes aleft-and-right pair of microphone 73 y and speaker 73 z, microphone 73 ywhich absorbs sound emitted by operator op, and speaker 73 z whichoutputs sound or the like emitted by the user. Meanwhile, in additionthat the left-and-right pair of speaker and microphone are integrated asthe headset, the left-and-right pair of speaker and microphone mayinclude stand-alone housings, respectively.

Communication controller 60 as an example of a second communicator is anetwork I/F that performs secure communication through communicationcontroller 20 of information displaying terminal 10 and network 90.Specifically, communication controller 60 transmits data, which includesthe image of the face and at least the part of the upper body of theoperator captured by third camera 63 and an image of the hands of theoperator captured by fourth camera 64, to information displayingterminal 10. In addition, communication controller 60 receives the imageof the face of the user and the image of the hands of the user which aretransmitted from information displaying terminal 10.

FIG. 3 is a perspective diagram illustrating an example of appearance ofinformation providing terminal 50. FIG. 4 is a perspective diagramillustrating an example of an inside disposition of informationproviding terminal 50 in a state in which top plate 112 y and side plate112 x on one side are detached. FIG. 5 is a diagram illustrating theinside of the information providing terminal 50, which is viewed fromthe lateral side, in the state in which top plate 112 y and side plate112 x on one side are detached.

As described above, information providing terminal 50 includesoperational desk 110 as a principal component, and has a configurationin which third display panel 53, fourth display panel 54, half mirror75, third camera 63, and fourth camera 64 are disposed on operationaldesk 110.

Portal support stand 112 is fixed to the operational surface ofoperational desk 110. Support stand 112 has a structure in which topplate 112 y, two pieces of side plates 112 x, and rear surface plate 112w are attached to frame 112 z which is arranged in an approximately boxshape. A surface, which faces the operator, of support stand 112 isopen. Meanwhile, in FIG. 4 and FIG. 5, in order to easily understand aninside of support stand 112, one piece of side plate 112 x and top plate112 y are detached for convenience.

Fourth display panel 54 is attached to the operational surface ofoperational desk 110 in a state of being obliquely inclined, forexample, by 45° to a rear side (a side opposite to the operator), andthus it becomes easy for the operator to visually recognize fourthdisplay panel 54. For example, switching menu 122, which is capable ofswitching between pieces of display content to be displayed on fourthdisplay panel 54, is displayed on fourth display panel 54. Fourthdisplay panel 54 includes the touch panel. The user may operateswitching menu 122 by directly touching fourth display panel 54 or usinga mouse.

In addition, third camera 63, which is capable of imaging the operator,is fixed to frame 112 z on a rear surface plate side of support stand112. In addition, third display panel 53 is fixed to frame 112 z on atop plate side of support stand 112. Half mirror 75 is attached to acenter of the inside of support stand 112 such that half mirror 75 issupported by obliquely protruded frame 112 z.

Half mirror 75, which functions as a reflection section, reflects lightattributable to an image, which is projected onto third display panel53, to the side of the operator, and is attached while being inclined bya prescribed angle (in the exemplary embodiment, for example, 45° withrespect to the operational surface) such that incident light from theside of the operator to third camera 63 passes therethrough. In theexemplary embodiment, a function as a prompter system is formed by halfmirror 75, third display panel 53, and third camera 63.

Generally, a prompter includes a transparent glass plate which isdisposed while being inclined by the prescribed angle with respect tothe operator, and causes the operator to visually recognize information,such as characters, in such a way that, for example, the information,such as the characters, displayed on a display (a monitor, a PC, or thelike) placed at a lower part is projected onto the transparent glassplate and the transparent glass plate reflects the information, such asthe characters, to the side of the operator. In the exemplaryembodiment, half mirror 75 is formed of the transparent glass plate.

In addition, two pieces of side plates 112 x, top plate 112 y, and rearsurface plate 112 w of support stand 112 function as a hood (cover)which shields external light that is incident on half mirror 75. Thatis, fourth display panel 54, third display panel 53, and half mirror 75are covered by top plate 112 y, two pieces of side plates 112 x, andrear surface plate 112 w except front surface, and thus it is possibleto shield the external light. Therefore, visibility of the image, whichis projected onto fourth display panel 54, third display panel 53, andhalf mirror 75, is secured.

In addition, in the exemplary embodiment, fourth display panel 54, halfmirror 75, and third display panel 53 are disposed such that a center offourth display panel 54, a center of half mirror 75, and a center ofthird display panel 53 are located on approximately the same verticalline. In a case where the center of half mirror 75 and the center ofthird display panel 53 are located on approximately the same verticalline, it is possible for half mirror 75 to face the operator withoutmissing the image projected onto third display panel 53 and withoutunnecessarily enlarging a size of half mirror 75.

In addition, fourth camera 64 is attached to bar 57, which extends tothe side of the operator as a part of frame 112 z disposed at the upperpart of support stand 112, such that the hands of the operator is easilyimaged.

Information providing terminal 50 has a reverse disposition structure inwhich third display panel 53 is disposed at an upper part of half mirror75 and third camera 63 is disposed at the back of half mirror 75, andwhich is different from the disposition of prompter system. In thereverse disposition, half mirror 75 is disposed between third displaypanel 53 and fourth display panel 54. In contrast, in the prompter,normally, monitor corresponding to the third display panel is disposedat a lower part of the half mirror.

Meanwhile, similar to the normal prompter, information providingterminal 50 may have a normal disposition structure in which thirddisplay panel 53 is disposed at a lower part of half mirror 75 and isattached to the back side of fourth display panel 54. In the normaldisposition, half mirror 75 is disposed at an upper part of thirddisplay panel 53 and fourth display panel 54. In addition, an angle ofinclination of half mirror 75 in the normal disposition faces anopposite direction of an angle of inclination of half mirror 75 in thereverse deposition with respect to a horizontal direction, and is anangle in which a reflection surface floats with respect to the side ofthe operator.

In the normal disposition, third display panel 53 is disposed at theback of fourth display panel 54, and thus a length of support stand 112in a depth direction becomes long. Therefore, the support stand becomeslarge, and thus it is difficult to make the support stand compact. Inaddition, a useless space, which is not used, is generated at an upperpart of an inner side of the support stand.

In contrast, in the reverse disposition, it is possible to effectivelyutilize the upper part of the inner side of support stand 112, to whichthird display panel 53 is attached, without emptying out as the uselessspace, compared to the normal disposition. Accordingly, it is possibleto reduce the length of support stand 112 in the depth direction and itis possible to make support stand 112 compact.

Meanwhile, in a case where third display panel 53 is attached such thata direction of the image, which is projected onto third display panel 53in the reverse disposition, faces an opposite direction by 180° from adirection of the image, which is projected onto third display panel 53in the normal disposition, it is possible to align the directions of theimages which are projected onto the side of the operator.

FIG. 6A, FIG. 6B, and FIG. 6C are diagrams illustrating positionalrelation between half mirror 75 and third camera 63.

In FIG. 6A, half mirror 75 and third camera 63 are attached such that anoptical axis of third camera 63 is located at a lower end of half mirror75. In a case where an image from third display panel 53 is projectedonto the center of half mirror 75, third camera 63 images a facialpicture of the operator such that gaze of the operator slightly turnsupward. Therefore, it is possible for the user to talk with the operatorwho is displayed on first display panel 21 and has an expressionslightly looking up.

In FIG. 6B, half mirror 75 and third camera 63 are attached such thatthe optical axis of third camera 63 is located at the center of halfmirror 75. In a case where the image from third display panel 53 isprojected onto the center of half mirror 75, third camera 63 images thefacial picture of the operator such that the gaze of the operator facesthe front. Therefore, it is possible for the user to talk with theoperator who is displayed on first display panel 21 and has anexpression viewed directly forward.

In FIG. 6C, half mirror 75 and third camera 63 are attached such thatthe optical axis of third camera 63 is located at an upper end of halfmirror 75. In a case where the image from third display panel 53 isprojected onto the center of half mirror 75, third camera 63 images thefacial picture of the operator such that the gaze of the operator facesslightly downward. Therefore, it is possible for the user to talk withthe operator who is displayed on first display panel 21 and has anexpression slightly looking down.

In information providing terminal 50, which has the above structure, theoperator has a conversation with the user while viewing a facial pictureof the user projected onto half mirror 75. Third camera 63 disposed atthe back of half mirror 75 images the facial picture of the operatorfrom the front over half mirror 75. At this time, the facial picture ofthe operator, which faces the front, is projected onto first displaypanel 21 of information displaying terminal 10. Therefore, the user getsan impression in which the operator is talking with the user whilemaking eye contact, and thus it is possible to provide talking whichbrims with the sense of realism.

In addition, the operator slightly moves gaze to fourth display panel 54which is located at a lower part of half mirror 75, and operates fourthdisplay panel 54 using a touch panel, a mouse, or the like while viewingthe picture of the hands of the user displayed on fourth display panel54. At this time, fourth camera 64 images the vicinity of the hands ofthe operator. In addition, the picture of the vicinity of the hands ofthe operator, which is imaged by fourth camera 64, is projected ontosecond display panel 22 of information displaying terminal 10. It ispossible for the user to view the picture of the vicinity the hands ofthe operator, which is projected onto second display panel 22, whileviewing a figure in which the operator gazes below and which isprojected onto first display panel 21. Therefore, the user gets animpression in which the operator performs an operation before user'seyes during the conversation, and thus it is possible to provide ananswer which brims with the sense of realism.

FIRST MODIFICATION EXAMPLE

FIG. 7A and FIG. 7B are diagrams illustrating an appearance ofinformation displaying terminal 10A according to a first modificationexample. FIG. 7A is an appearance diagram of information displayingterminal 10A, which is viewed from a front direction, according to thefirst modification example. FIG. 7B is an appearance diagram ofinformation displaying terminal 10A, which is viewed from a lateraldirection, according to the first modification example. Compared toinformation displaying terminal 10 according to the exemplaryembodiment, information displaying terminal 10A includes an integratedslim housing 212 which has a short depth, a narrow width, and a heightthat is approximately equal to a height of human (life size). At acenter of a front surface of housing 212, monitor stand 213 is providedto extend to the front side from housing 212. In addition, first displaypanel 21A is disposed on a front surface of an upper part (in thedrawing, an upper part than monitor stand 213) of housing 212. Thefacial picture of the operator imaged by third camera 63 is displayed onfirst display panel 21A.

In addition, interphone 25 z is disposed on a side of first displaypanel 21A instead of the speaker and the microphone. In addition, secondcamera 32A, which images the hands of the user, and first camera 31A,which images the facial picture of the user, are disposed at the top andthe bottom of first display panel 21A, respectively, as in the firstexemplary embodiment.

In addition, hood 214 is provided to extend from both side parts ofhousing 212 at a lower part of monitor stand 213. Printer slot 40 z,through which printed paper is discharged, is provided at a lower partof monitor stand 213. In addition, it is possible for the user to easilystore baggage or the like in a space which is the lower part of monitorstand 213 and is surrounded by hood 214.

As described above, since information displaying terminal 10A accordingto the first modification example has the life size, it is possible forthe user to face the facial picture of the operator, which is projectedonto first display panel 21A, while standing. Therefore, it is possiblefor the user to communicate with the operator with further natural gaze.In addition, it is possible to use a space provided at the lower part ofmonitor stand 213 as an easy storage in which it is possible totemporarily put luggage or the like, thereby improving convenience.

SECOND MODIFICATION EXAMPLE

FIG. 8A and FIG. 8B are diagrams illustrating an appearance ofinformation displaying terminal 10B according to a second modificationexample. FIG. 8A is a perspective diagram illustrating the appearance ofinformation displaying terminal 10B according to the second modificationexample. FIG. 8B is a diagram of information displaying terminal 10B,which is viewed from the lateral side, according to the secondmodification example.

Information displaying terminal 10B has housing 212B, which has afurther shorter depth and which is slim, compared to informationdisplaying terminal 10A according to the first modification example. Inaddition, an inverted V-shaped base member 215, which supports housing212B such that housing 212B does not fall down, is provided at a lowerend part of housing 212B.

Furthermore, housing 212B is inclined by a prescribed angle to lean on arear side with respect to a vertical direction. Therefore, a displaysurface of first display panel 21B faces slightly upward, thereby facingthe face of the operator. Therefore, visibility of the user is improved.

In addition, an operational surface of monitor stand 213B is inclined toa lower side by the prescribed angle (for example, 15°) with respect tothe horizontal direction. Therefore, the operational surface of seconddisplay panel 22B is widely viewed to the user on the front side, andthus it is easy to perform an operation of the hands. Accordingly,usability of the user is improved.

THIRD MODIFICATION EXAMPLE

FIG. 9A and FIG. 9B are perspective diagrams illustrating appearances ofinformation displaying terminals 10C and 10D, which have differentsizes, according to a third modification example. FIG. 9A is aperspective diagram illustrating the appearance of informationdisplaying terminal 10C, which has a normal size, according to the thirdmodification example. Information displaying terminal 10C has a sizewhich is approximately the same as that of information displayingterminal 10A according to the first modification example, and hasmonitor stand 213C, which is inclined by the prescribed angle on thefront side, unlike information displaying terminal 10A. Accordingly, itis easy for the user to perform an operation on an operational surfaceof second display panel 22C while standing up in a case where the useris talking while viewing the face of the operator displayed on firstdisplay panel 21C.

FIG. 9B is an appearance diagram illustrating information displayingterminal 10D, which has a small size and is viewed from a frontdirection, according to the third modification example. Compared toinformation displaying terminal 10D, which has the normal size,information displaying terminal 10D has low height, and thus it is easyfor the gaze of the operator to match that of a child or a user in awheelchair. Accordingly, usability of the child and the user in thewheelchair is improved.

As described above, information displaying system 5 according to theexemplary embodiment is an information displaying system, in whichinformation displaying terminal 10, which can be operated by the user,is connected to information providing terminal 50, which can be operatedby the operator, such that communication is possible. Informationdisplaying terminal 10 includes first camera 31 which captures the imageof the face of the user, second camera 32 which captures the image ofthe hands of the user, communication controller 20 (first communicator)which transmits data relevant to the image of the face of the user andthe image of the hands of the user to information providing terminal 50and receives the image of the face and at least the part of the upperbody of the operator and the image of the hands of the operator that aretransmitted from information providing terminal 50, first display panel21 which displays the image of the face and at least the part of theupper body of the operator, and second display panel 22 which displaysthe image of the hands of the operator. Information providing terminal50 includes third camera 63 which images the face and at least the partof the upper body of the operator, fourth camera 64 which images thehands of the operator, communication controller 60 (second communicator)which transmits data relevant to the image of the face and at least thepart of the upper body of the operator and the image of the hands of theoperator to information displaying terminal 10 and receives the image ofthe face of the user and the image of the hands of the user that aretransmitted from information displaying terminal 10, third display panel53 that displays the image of the face of the user, and fourth displaypanel 54 that displays the image of the hands of the user. Half mirror75 (reflection section), which reflects pieces of display content ofthird display panel 53 toward the operator and causes incident light ofthird camera 63 to pass therethrough, is obliquely attached to the upperpart of fourth display panel 54 by 45° (prescribed angle) with respectto the horizontal direction. Third camera 63 is disposed behind halfmirror 75.

In information displaying system 5, the operator has a conversation withthe user while viewing the facial picture of the user which is projectedby third display panel 53 and is projected onto half mirror 75. Thirdcamera 63 disposed at the back of half mirror 75 images the facialpicture of the operator from the front over half mirror 75. At thistime, the facial picture of the operator, which faces the front, isprojected onto first display panel 21 of information displaying terminal10. Therefore, in information displaying system 5, it is possible tosave a space of the installation device in disposition of theoperator-side terminal and to perform communication with the user with anatural gaze.

In addition, third display panel 53 is disposed at an upper part thanfourth display panel 54, and half mirror 75 is disposed between thirddisplay panel 53 and fourth display panel 54. Therefore, it is possibleto effectively utilize the upper part of the inner side of support stand112, to which third display panel 53 is attached, without making theupper part be empty as the useless space. Therefore, it is possible toreduce the length of support stand 112 in the depth direction, and it ispossible to make support stand 112 be compact.

In addition, half mirror 75 is attached such that the optical axis ofthird camera 63 passes through a central part of half mirror 75.Therefore, in a case where the image from third display panel 53 isprojected onto the center of half mirror 75, third camera 63 images thefacial picture of the operator such that the gaze of the operator facesthe front. Therefore, it is possible for the user to talk with theoperator who is displayed on first display panel 21 and has anexpression which is viewed right in front.

In addition, half mirror 75 is attached such that the optical axis ofthird camera 63 passes through an upper end part of half mirror 75.Therefore, in a case where the image from third display panel 53 isprojected onto the center of half mirror 75, third camera 63 images thefacial picture of the operator such that the gaze of the operator facesslightly downward. Therefore, it is possible for the user to talk withthe operator who is displayed on first display panel 21 and has theexpression slightly looking down.

In addition, half mirror 75 is attached such that the optical axis ofthird camera 63 passes through a lower end part of half mirror 75.Therefore, in a case where the image from third display panel 53 isprojected onto the center of half mirror 75, third camera 63 images thefacial picture of the operator such that the gaze of the operator facesslightly upward. Therefore, it is possible for the user to talk with theoperator who is displayed on first display panel 21 and has theexpression slightly looking up.

Details and Task of Second Exemplary Embodiment

Furthermore, in order to make the user brim with the sense of realism,it is necessary to accurately and rapidly send information to the user,and it is desired to improve usability for the operator in such a waythat the camera which images the face and the hands of the operator andthe operator-side monitor on which the face and the hands of the userare displayed are provided.

Here, in a case where the camera which images the face and the hands ofthe operator and the operator-side monitor on which the face and thehands of the user are displayed are used, it is possible to provide thesense of realism in which the user actually faces the communicationpartner, and thus it is desired to enable the usability for the operatorto be improved.

Second Exemplary Embodiment

An information displaying system according to a second exemplaryembodiment has approximately the same configuration as in the firstexemplary embodiment. The same symbols are used for the same componentsas in the first exemplary embodiment, and the description thereof willnot be repeated.

FIG. 10 is a block diagram illustrating an example of an insideconfiguration of information displaying terminal 10 and informationproviding terminal 50A according to the second exemplary embodiment.Information providing terminal 50A according to the second exemplaryembodiment includes display switching remote controller 85 and remotecontroller receiver 83, which performs wireless connection with remotecontroller 85, in addition to information providing terminal 50according to the first exemplary embodiment.

In addition, controller 51A in information providing terminal 50Aincludes display switching controller 51 z which switches between piecesof display content on third display panel 53 and fourth display panel 54according to an instruction which is received by remote controllerreceiver 83 from remote controller 85 or according to selection ofswitching menu 122 (refer to FIG. 11) displayed on fourth display panel54.

A display switching operation in information displaying system 5A whichhas the above configuration will be described.

FIG. 11 is a diagram illustrating switching menu 122 which is displayedon fourth display panel 54. A UI screen, which enables the touchoperation, is displayed on fourth display panel 54. As a part of the UIscreen, switching menu 122, in which it is possible to switch betweenthe pieces of display content displayed on third display panel 53 andfourth display panel 54, is displayed on fourth display panel 54.

A list of display items of third display panel 53 and fourth displaypanel 54 is selectably displayed in switching menu 122. As the displayitems of third display panel 53,

No. 1 the face of the user (initial state),

No. 2 the hands of the user,

No. 3 the face of the operator,

No. 4 the hands of the operator,

and the like are selectable. As the display items of fourth displaypanel 54,

No. 5 the hands of the user and the UI screen (initial state),

No. 6 the face of the user,

No. 7 the face of the operator,

No. 8 the hands of the operator,

and the like are selectable.

Normally, an operation of fixing the display items of any one of thirddisplay panel 53 and fourth display panel 54 to the initial state andselecting or changing the display items of the other display panel isperformed. However, an operation of selecting or changing the displayitems of both the display panels may be performed.

In a case where fourth display panel 54 includes a touch panel, theoperator is capable of selecting any one of the display items ofswitching menu 122 and switching between the pieces of display contentby directly performing the touch operation on fourth display panel 54.In addition, the operator may select a desired display item by operatingmarker 122 z or 122 y of switching menu 122 up and down using remotecontroller 85. In addition, the operator may switch into a desireddisplay item by directly designating, for example, a number withoutusing switching menu 122.

Subsequently, a use case acquired in a case where the pieces of displaycontent of third display panel 53 and fourth display panel 54 areswitched will be described. Normally, in the initial state, first camera31 on a side of information displaying terminal 10 images the face ofthe user (customer). Second camera 32 on the side of informationdisplaying terminal 10 images the hands of the user. In contrast, thirdcamera 63 on a side of information providing terminal 50A images theface of the operator. Fourth camera 64 on the side of informationproviding terminal 50A images the hands of the operator.

In addition, third display panel 53 on the side of information providingterminal 50A is a small-sized monitor, and normally displays the facialpicture of the user in the initial state. Fourth display panel 54 on theside of information providing terminal 50A is a large-sized monitor, andnormally displays the picture of the hands of the user and the UserInterface (UI) screen in the initial state.

FIG. 12A, FIG. 12B, and FIG. 12C are diagrams illustrating the displayscreens of third display panel 53 in respective use cases. As describedabove, third display panel 53 on the side of information providingterminal 50A normally displays the facial picture of the user.

In a first use case, third display panel 53 displays the picture of thehands of the user imaged by second camera 32 on the side of informationdisplaying terminal 10. In this case, the operator operates the UIscreen displayed on fourth display panel 54.

Specifically, a situation as illustrated in FIG. 12A is assumed. In acase where the user (customer) brings paper media, such as a shop map, aleaflet, and a pamphlet, spreads the paper media around the hands, andinquires of the operator about the paper media, second camera 32 imagesthe paper media. The operator operates the UI screen of fourth displaypanel 54 while checking information of the paper media displayed onthird display panel 53, searches for relevant information, such asexistence or non-existence of a stock, a shop, or the like, and providesa suitable reply to the user.

In a second use case, third display panel 53 displays the facial picture(including the upper body) of the operator imaged by third camera 63 onthe side of information providing terminal 50A. The operator adjustsfocus alignment, zooming-in/out, or the like of third camera 63 whileviewing the facial picture of the operator which is displayed on thirddisplay panel 53.

Specifically, there is a case where a focus of the image of the operatorcaptured by third camera 63 is minutely deviated according to a build, away of sitting, or the like of the operator. In a case where initialsetting is performed on information displaying system 5 or the like, theoperator appropriately changes setting of third camera 63 while checkinga way that the facial picture of the operator is viewed for the user(customer) through third display panel 53.

As illustrated in FIG. 12B, normally, third display panel 53 displaysthe face of the user, and the operator talks with the user while viewingthird display panel 53. Therefore, it is possible for the operator tocheck the image of the operator in a state as it is without changing thegaze even in a case where the facial picture of the operator imaged bythird camera 63 is switched. Accordingly, in a case where the operatoradjusts third camera 63 while viewing third display panel 53, it ispossible for the operator to easily check the image of the operatorwhich is actually viewed to the user. Therefore, it is possible toeasily adjust third camera 63.

In a third use case, as illustrated in FIG. 12C, third display panel 53displays the picture of the hands of the operator imaged by fourthcamera 64. The operator adjusts the focus alignment, the zooming-in/out,or the like of fourth camera 64 while viewing the picture of the handsof the operator displayed on third display panel 53.

In a case where initial setting is performed on information displayingsystem 5 or the like, the operator performs focus alignment on fourthcamera 64. In a case where the operator talks with the user (customer)and third display panel 53 displays the map or the leaflet as thepicture of the hands of the operator, fourth camera 64 is caused toperform enlargement through optical zooming-in/out, and thus the map orthe leaflet, which is difficult to be viewed on third display panel 53,becomes clear. Therefore, it is possible for the user to check contentsof the map or the leaflet. Meanwhile, after the operator causes fourthcamera 64 to perform enlargement, the operator may return setting of alocation (coordinates) of fourth camera 64 or the like to a previouslystored preset value (initial position).

FIG. 13A, FIG. 13B, and FIG. 13C are diagrams illustrating displayscreens of fourth display panel 54 in respective use cases. As describedabove, normally, fourth display panel 54 displays the picture of thehands of the user and the UI screen. Meanwhile, in a case where the UIscreen exists in the vicinity of the hands in addition to the hands, thepicture of the hands includes the UI screen.

In a fourth use case, fourth display panel 54 displays the picture ofthe hands of the user. Normally, third display panel 53 displays thefacial picture of the user imaged by first camera 31. However, in a casewhere it is difficult to check contents in a range corresponding to thefacial picture in the image which is captured by second camera 32,fourth display panel 54 takes action against the case.

Specifically, in a case where a product, which is brought by the user,is small or is too large, there is a case where it is difficult for theoperator to correctly check contents of the product in the picture ofthe hands of the user which is imaged by second camera 32 installed atthe upper part of information displaying terminal 10. Here, in a casewhere the operator performs an instruction with respect to first camera31, which is installed at a lower part of information displayingterminal 10, using sounds or the like such that the user performsimaging by approaching or keeping away from the product, it is possiblefor the operator to check the contents of the product, which is imagedby first camera 31 and is displayed by fourth display panel 54, asillustrated in FIG. 13A.

In a fifth use case, as illustrated in FIG. 13B, fourth display panel 54displays the facial picture of the operator (including the upper body)imaged by third camera 63. The operator talks with the user whilechecking a way that the facial picture of the operator is viewed to theuser (customer).

In a sixth use case, as illustrated in FIG. 13C, fourth display panel 54displays the picture of the hands of the operator imaged by fourthcamera 64. The operator talks with the user while checking a way thatthe picture of the hands of the operator is viewed to the user. In thiscase, similar to the third use case, the operator adjusts the focusadjustment, the zooming-in/out, or the like of fourth camera 64.Meanwhile, fourth display panel 54 may simultaneously display thepicture of the hands of the operator and the UI screen. In a case wherethe picture of the hands of the operator and the UI screen aresimultaneously displayed, it is possible to display the picture of thehands of the operator as a picture-in-picture image in which the pictureof the hands of the operator is displayed in a small window.

As described above, information displaying system 5A according to thesecond exemplary embodiment is an information displaying system in whichinformation displaying terminal 10 which can be operated by the user isconnected to information providing terminal 50A which can be operated bythe operator such that communication is possible. Information displayingterminal 10 includes first camera 31 which captures the image of theface of the user, second camera 32 which captures the image of the handsof the user, communication controller 20 (first communicator) whichtransmits the data relevant to the image of the face of the user and theimage of the hands of the user to information providing terminal 50A andreceives the image of the face and at least the part of the upper bodyof the operator and the image of the hands of the operator that aretransmitted from information providing terminal 50A, first display panel21 which displays the image of the face and at least the part of theupper body of the operator, and second display panel 22 which displaysthe image of the hands of the operator. Information providing terminal50A includes third camera 63 which images the face and at least the partof the upper body of the operator, fourth camera 64 which images thehands of the operator, communication controller 60 (second communicator)which transmits the data relevant to the image of the face and at leastthe part of the upper body of the operator and the image of the hands ofthe operator to information displaying terminal 10 and receives theimage of the face of the user and the image of the hands of the userthat are transmitted from information displaying terminal 10, thirddisplay panel 53 that displays the image of the face of the user, andfourth display panel 54 that displays the image of the hands of theuser. Display switching controller 51 z (switching processor) instructsto switch between the pieces of display content of third display panel53 from the image of the face of the user captured by first camera 31 tothe image captured by any one of second camera 32, third camera 63, andfourth camera 64.

As described above, in a case where the camera, which images the faceand the hands of the operator or the user, and the operator-side displaypanel, on which the face and the hands of the user is displayed, areused, it is possible to switch between the pieces of display content ofthe third display panel from an image of the face of the user to anothercaptured image. Accordingly, it is possible to provide the sense ofrealism in which the user actually faces the communication partner, andit is possible to improve the usability of the operator.

In addition, display switching controller 51 z instructs to switchbetween the pieces of display content of fourth display panel 54 fromthe image of the hands of the user captured by second camera 32 to animage captured by any one of first camera 31, third camera 63, andfourth camera 64. Therefore, it is possible to switch between the piecesof display content of fourth display panel from the picture of the handsof the user to another imaged image, and thus it is possible to improvethe usability of the operator.

In addition, information displaying system 5 includes display switchingremote controller 85. Display switching controller 51 z instructs toperform switching through an operation of remote controller 85. Asdescribed above, in a case where the remote controller is used, it ispossible to simply instruct to perform switching. In addition, even in acase where a person who possesses the remote controller is in a locationseparated from the information providing terminal, it is possible toinstruct to switch between the pieces of display content. Furthermore,even in a case where the operator does not know the switch between thepieces of display content, it is possible to instruct to switch betweenthe pieces of display content, instead.

In addition, fourth display panel 54 displays switching menu 122.Display switching controller 51 z instructs to perform switching throughan operation with respect to switching menu 122. Therefore, it ispossible for the operator to simply instruct to perform switching whileviewing fourth display panel.

As above, various exemplary embodiments are described with reference tothe drawings. However, the present disclosure is not limited to theexamples. It is apparent that those skilled in the art understand thatvarious modification examples or changed examples are conceivable in acategory disclosed in claims and the modification examples or thechanged examples are included in a technical scope of the presentdisclosure.

For example, in the second exemplary embodiment, a case where theinformation displaying terminal communicates with the informationproviding terminal one to one in the information displaying system isillustrated. However, it is also possible to apply a case wherecommunication is performed through multipoint connection, such as 1 toN, N to 1, or N to N (N: plural number), to the present disclosure. Inaddition, in the case where communication is performed through themultipoint connection, the first display panel to the fourth displaypanel may display facial pictures or the pictures of the hands imaged bycameras in plural terminals through multi-screen display or screenswitching display. Furthermore, the first display panel to fourthdisplay panel may be capable of displaying plural pieces of terminalinformation altogether.

In addition, in the second exemplary embodiment, in a case where thepieces of display content of third display panel 53 and the pieces ofdisplay content of fourth display panel 54 are switched, it is possibleto fix the pieces of display content of one of third display panel 53and fourth display panel 54 and to randomly switch the pieces of displaycontent of the other display panel. However, the pieces of displaycontent of both third display panel 53 and fourth display panel 54 maybe simultaneously switched. In a case where the pieces of displaycontent of both third display panel 53 and fourth display panel 54 aresimultaneously switched, a combination of the pieces of display contentmay be previously registered according to the use cases.

In addition, in the second exemplary embodiment, the informationproviding terminal may be configured such that the operator directlyviews the fourth display panel without using the prompter system, thatis, without passing through the half mirror.

In addition, in each of the exemplary embodiment, in a case where theinformation displaying terminal projects the image of the face and atleast the part of the upper body of the operator, a chest part isprojected as at least a part of the upper body which is felt mostnaturally. However, an elbow part or a lumbar part may be projected. Inaddition, a head part or only a face may be projected without projectingthe upper body. In addition, it is desired that the face and a part ofthe upper body, which are projected onto the display panel, areprojected to coincide with actual sizes, thereby providing furthernatural feeling. In addition, in a case where the information displayingterminal includes a life-sized display panel, a whole body of theoperator may be projected. In this case, the operator may have astanding posture or a sitting posture similar to the user.

INDUSTRIAL APPLICABILITY

The information displaying system and the information providing terminalaccording to the present disclosure are useful as an informationdisplaying system and an information providing terminal which save aspace of an installment device in disposition of the operator-sideterminal and which are capable of performing communication with the userwith natural gaze.

REFERENCE MARKS IN THE DRAWINGS

5 INFORMATION DISPLAYING SYSTEM

10, 10A, 10B, 10C, 10D INFORMATION DISPLAYING TERMINAL

11, 51 CONTROLLER

12 STAND

15 FIRST HOUSING

15 z MIDDLE PART

18 SECOND HOUSING

18 z FRONT END SURFACE

20, 60 COMMUNICATION CONTROLLER

21, 21A, 21B, 21C FIRST DISPLAY PANEL

22, 22B SECOND DISPLAY PANEL

25L, 25R SPEAKER

25 z INTERPHONE

27 MICROPHONE

31 FIRST CAMERA

32 SECOND CAMERA

40 PRINTER

40 z PRINTER SLOT

42 READING DEVICE

50, 50A INFORMATION PROVIDING TERMINAL

51, 51A CONTROLLER

51 z DISPLAY SWITCHING CONTROLLER

53 THIRD DISPLAY PANEL

54 FOURTH DISPLAY PANEL

57 BAR

63 THIRD CAMERA

64 FOURTH CAMERA

68 CONSOLE

69 SCANNER

73 HEADSET

75 HALF MIRROR

83 REMOTE CONTROLLER RECEIVER

85 REMOTE CONTROLLER

90 NETWORK

110 OPERATIONAL DESK

112 SUPPORT STAND

112 w REAR SURFACE PLATE

112 x SIDE PLATE

112 y TOP PLATE

112 z FRAME

122 SWITCHING MENU

122 y, 122 z MARKER

212, 212B HOUSING

213, 213B, 213C MONITOR STAND

214 HOOD

215 BASE MEMBER

op OPERATOR

1. An information displaying system, in which an information displayingterminal that can be operated by a user is connected to an informationproviding terminal that can be operated by an operator such thatcommunication is possible, wherein the information displaying terminalincludes a first camera that captures an image of a face of the user; asecond camera that captures an image of hands of the user; a firstcommunicator that transmits the image of the face of the user and theimage of the hands of the user to the information providing terminal,and that receives an image of a face and at least a part of an upperbody of the operator and an image of hands of the operator which aretransmitted from the information providing terminal; a first displaypanel that displays the image of the face and at least the part of theupper body of the operator; and a second display panel that displays theimage of the hands of the operator, and wherein the informationproviding terminal includes a third camera that images the face and atleast the part of the upper body of the operator; a fourth camera thatimages the hands of the operator; a second communicator that transmitsthe image of the face and at least the part of the upper body of theoperator and the image of the hands of the operator to the informationdisplaying terminal, and receives the image of the face of the user andthe image of the hands of the user which are transmitted from theinformation displaying terminal; a third display panel that displays theimage of the face of the user; a fourth display panel that displays theimage of the hands of the user; and a switching processor that instructsto switch between pieces of display content of the third display panelfrom the image of the face of the user captured by the first camera tothe image captured by any one of the second camera, the third camera,and the fourth camera.
 2. The information displaying system of claim 1,wherein the switching processor instructs to switch between pieces ofdisplay content of the fourth display panel from the image of the handsof the user captured by the second camera to the image captured by anyone of the first camera, the third camera, and the fourth camera.
 3. Theinformation displaying system of claim 1, further comprising: a displayswitching remote controller, wherein the switching processor instructsto perform the switching through an operation of the remote controller.4. The information displaying system of claim 1, wherein the fourthdisplay panel displays a switching menu, and wherein the switchingprocessor instructs to perform the switching through an operation withrespect to the switching menu.
 5. An information providing terminal,which is connected to information displaying terminal that can beoperated by a user such that communication is possible and which can beoperated by an operator, the information providing terminal comprising:a first camera that images a face and at least a part of an upper bodyof the operator; a second camera that images hands of the operator; acommunicator that transmits an image of the face and at least the partof the upper body of the operator and an image of the hands of theoperator to the information displaying terminal, and receives an imageof a face of the user and an image of hands of the user which aretransmitted from the information displaying terminal; a first displaypanel that displays the image of the face of the user; a second displaypanel that displays the image of the hands of the user; and a switchingprocessor that instructs to switch between pieces of display content ofthe first display panel from the image of the face of the user capturedby the first camera to any one of the image of the hands of the user,the image captured by the first camera, and the image captured by thesecond camera.